Method of launching an application and selecting the application target window

ABSTRACT

A method of launching a software program or application is provided for use with a graphical user interface (GUI) display. One portion of the GUI display includes a taskbar while a second portion is divided into a plurality of windows. To launch one of the programs/applications represented by the icons within the taskbar, the user first selects the icon representing the icon to be launched. When the user drags the selected icon into one of the windows and then releases the icon, the selected program/application is launched in the selected window.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.13/764,942, filed 12 Feb. 2013, the disclosure of which is incorporatedherein by reference for any and all purposes. This application claimsthe benefit of the filing date of U.S. Provisional Patent ApplicationSer. No. 61/706,915, filed 28 Sep. 2012, the disclosure of which isincorporated herein by reference for any and all purposes.

FIELD OF THE INVENTION

The present invention relates generally to a user interface and, moreparticularly, to a method of launching an application on a userinterface.

BACKGROUND OF THE INVENTION

A conventional computer interface provides a variety of simplifiedtechniques that can be used to select and activate a particular programor application. While the nomenclature and some of the launch featuresvary depending upon the operating system, in general these techniquesallow a shortcut for the desired program/application to be placeddirectly on the desktop or within a taskbar or dock located at a screenedge, for example along the top or bottom of the screen. When the userselects a particular program/application, either by tapping (or doubletapping) on the program/application icon if the interface is atouch-screen, or selecting the program/application by clicking (ordouble clicking) on the icon using a mouse, the program/applicationopens up on the screen. Generally the program/application will open in afull screen mode, i.e., maximized to cover the entire screen window. Insome operating systems, if the program/application was minimized priorto its last closure, when re-opened it will re-open in the same sizewindow as when it was closed. Similarly, if the program/application wasminimized prior to its last closure, when re-opened theprogram/application will typically be located in the same location onthe screen as where it was when it was last closed.

When a touch-screen or mouse-controlled user interface is used in avehicle, the driver is often required to open an application, inputdata, or otherwise interact with the interface in a rushed manner andwhile performing other tasks related to driving the car. In this andsimilar scenarios, conventional application shortcuts may provide theuser with insufficient control. Accordingly, what is needed is shortcuttechnique that optimizes user control over the opening application, thusminimizing user interaction while still providing the user with thedesired level of control. The present invention provides such a userinterface.

SUMMARY OF THE INVENTION

A method for launching programs, e.g., software programs andapplications, on a graphical user interface (GUI) display is provided,the method including the steps of (i) providing a taskbar on a firstportion of the GUI display; (ii) displaying a plurality of icons withinthe taskbar, where each of the icons represents a corresponding one of aplurality of programs; (iii) configuring a second portion of the GUIdisplay into a plurality of pre-sized windows; (iv) accepting a userselection of a selected icon of the plurality of icons located withinthe taskbar, where the selected icon represents the software applicationto be launched; (v) allowing the user to drag the selected icon from aninitial location on the taskbar to a selected window of the plurality ofwindows; and (vi) launching the software application in the selectedwindow when the selected icon is released by the user within theselected window. The user can select/drag an icon using a click-and-holdoperation of a mouse controller button and then release the icon byunclicking the mouse controller button or, in the case of atouch-screen, touch an icon to select it and then release the selectedicon by removing their finger from the selected icon at the desiredlocation.

In another aspect, a semi-transparent interface screen corresponding tothe software application is displayed on each of the plurality ofwindows as the selected icon is positioned within the correspondingwindow. Then, when the user releases the selected icon, thesemi-transparent interface screen completely materializes in theselected window.

In another aspect, the GUI display may be mounted in a vehicle and theplurality of programs may include one or more applications correspondingto entertainment system applications, navigation system applications,energy tracking applications, browser applications, camera applicationsand phone applications.

In another aspect, a plurality of persistent controls are provided on athird portion of the GUI display, where the persistent controls mayinclude one or more of passenger cabin temperature controllers, vehicleseat warmer controllers, audio volume controllers, defroster controllersand general vehicle setting controllers.

In another aspect, when an icon is selected its appearance changes, forexample the icon may be enlarged or the color of the icon may changewhen it is selected.

In another aspect, after the software application is launched the usercan toggle between a window mode and a full-screen mode by tapping, orclicking, on the selected icon.

In another aspect, the user can immediately launch the softwareapplication in a full-screen mode, thereby bypassing the step ofdragging the selected icon to one of the windows, by double tapping, ordouble clicking, the selected icon.

A further understanding of the nature and advantages of the presentinvention may be realized by reference to the remaining portions of thespecification and the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 provides a block diagram of an exemplary interface system thatmay be used with the present invention;

FIG. 2 illustrates an exemplary GUI screen;

FIG. 3 illustrates an exemplary GUI screen based on the GUI screen shownin FIG. 2 after an application has been selected;

FIG. 4 illustrates an exemplary GUI screen with three available launchwindows after an application has been selected;

FIG. 5 illustrates an exemplary GUI screen with four available launchwindows after an application has been selected;

FIG. 6 illustrates the same view of the GUI screen as provided in FIG. 3except for the motion of the phone application icon;

FIG. 7 illustrates the same view of the GUI screen as provided in FIG. 6except for the continued motion of the phone application icon to thelower miniature window in the visual cue;

FIG. 8 illustrates the same view of the GUI screen as provided in FIG. 3except that the mini-window corresponding to the currently destinationwindow is highlighted;

FIG. 9 illustrates the same view of the GUI screen as provided in FIG. 8except that the application icon has been dragged from the upper to thelower visual cue window, thereby causing the highlighted mini-window tochange from the upper mini-window to the lower mini-window;

FIG. 10 illustrates the same view of the GUI screen as provided in FIG.3 except that the selected application is displayed in asemi-transparent state as an overlay on the currently selected visualcue window;

FIG. 11 illustrates the same view of the GUI screen as provided in FIG.10 except that the application has been dragged from the upper to thelower visual cue window, thereby causing the selected application to bedisplayed in a semi-transparent state as an overlay on the lower window;

FIG. 12 illustrates the same view of the GUI screen as provided in FIG.11 after the user has removed their finger from the touch-screen, orotherwise released the application, while the application icon is in thelower visual cue window;

FIG. 13 illustrates the first step of an alternate embodiment in whichthe user selects an application icon from the taskbar and drags it tothe window where it is to be opened;

FIG. 14 illustrates a selected icon from the exemplary GUI screen shownin FIG. 2 in the process of being dragged to the destination window;

FIG. 15 illustrates the selected icon in the destination window;

FIG. 16 illustrates the launch of the selected application once the userreleases the selected icon;

FIG. 17 illustrates a similar embodiment to that shown in FIG. 14,except that the selected application is displayed in a semi-transparentstate as an overlay; and

FIG. 18 illustrates a similar embodiment to that shown in FIG. 15,except that the selected application is displayed in a semi-transparentstate as an overlay; and

FIG. 19 illustrates a similar embodiment to that shown in FIG. 13,except that when the user selects an icon, the icon changes appearance.

DESCRIPTION OF THE SPECIFIC EMBODIMENTS

The preferred embodiment of the present invention utilizes a largeformat screen, preferably a touch-screen, which is of sufficient size toallow multiple windows to be opened. It will be appreciated that thescreen size required for multiple window viewing depends upon a numberof factors, including the user. Thus while the preferred embodimentutilizes a 17-inch touch-screen with a 16:10 aspect ratio, otherembodiments may utilize both smaller and larger screen sizes.

In the illustrated embodiment, the touch-screen display is used in avehicle, both as a visual aid and as a means of controlling multiplevehicle subsystems. It should be understood that the invention may alsobe used in non-vehicle applications (e.g., desktop computer, laptopcomputer, tablet, smartphone, etc.). If used within a vehiclecompartment, preferably the display is mounted within the vehicle'scentral console, thus providing access to the data on the screen as wellas the displayed system controls to both the driver and the passengerseated in the passenger front seat.

FIG. 1 provides a block diagram of an exemplary interface system 100that includes touch-screen 101 and is suitable for use with theinvention. In system 100, display 101 is coupled to a system controller103. Controller 103 includes a graphical processing unit (GPU) 105, acentral processing unit (CPU) 107, and memory 109. CPU 107 and GPU 105may be separate or contained on a single chip set. Memory 109 may becomprised of flash memory, a solid state disk drive, a hard disk drive,or any other memory type or combination of memory types. Controller 103is coupled to a variety of different vehicle subsystems, including thevehicle subsystem controls and vehicle subsystem monitors that are to beaccessed and/or viewed on display 101. Exemplary subsystems includeaudio subsystem 111, climate control subsystem 113, navigation subsystem115, drive train monitoring subsystem 117, charging subsystem 119,mobile phone subsystem 121, vehicle camera subsystem 123, vehicle set-upsubsystem 125 and web browser subsystem 127. Vehicle set-up subsystem125 allows general vehicle operating conditions to be set, conditionssuch as seat position, moon roof or sun roof position/operation,internal and external lighting, windshield wiper operation, etc.Preferably a mobile telecommunications link 129 is also coupled tocontroller 103, thereby allowing the controller to obtain updates,interface configuration profiles, and other data from an external datasource (e.g., manufacturer, dealer, service center, web-basedapplication, remote home-based system, etc.). Mobile telecommunicationslink 129 may be based on any of a variety of different standardsincluding, but not limited to, GSM EDGE, UMTS, CDMA2000, DECT, andWiMAX.

FIG. 2 provides an exemplary screen 200. It should be understood thatthe icons and information shown on this and subsequent graphical userinterface (GUI) screens is for illustration purposes only and that theinvention is equally applicable to screens utilizing a different format,size or configuration as well as interfaces utilizing differentoperating systems, different programs/applications, etc. Furthermore, itshould be understood that the terms “program”, “application” and“program/application” are used interchangeably throughout thisspecification.

A GUI display configured for use with the invention, regardless ofwhether the display is a touch-screen as preferred or anon-touch-screen, includes a dedicated taskbar region 201. Althoughtaskbar region 201 is shown positioned at the top of GUI screen 200, itwill be appreciated that it could be located elsewhere (e.g., at thebottom of the screen, along a side of the screen, etc.). Within taskbar201 are icons representative of the applications that provide the userwith shortcut access to each of the designated applications, for exampleapplications that control various vehicle subsystems. In one embodimentthe application shortcuts located within the taskbar are configured by athird party (e.g., the system or vehicle manufacturer) while in anotherembodiment the application shortcuts located within the taskbar areconfigured by the end user. Typically the shortcuts in taskbar 201 arefor those applications for which frequent access is desired. In theexemplary GUI screen the illustrated shortcuts are for amedia/audio/entertainment system application (i.e., media icon 203), anavigation system application (i.e., navigation icon 205), an energytracking application that monitors battery usage/charging (i.e., energyicon 207), a browser application (i.e., web icon 209), a cameraapplication for a back-up and/or forward view camera (i.e., camera icon211), and a mobile/cell phone interface application (i.e., phone icon213).

In accordance with the invention, a portion of the GUI display screen isdivided into two or more windows that are used to display the selectedapplications. In the exemplary screen 200, two windows are shown withupper window 215 displaying web browser application 209 and lower window217 displaying a map selected via navigation interface application 205.In the preferred embodiment, a selected window may be expanded to coverall of the windows, a particularly useful feature when either the webbrowser or the navigation system is selected. Additionally, in someembodiments the user can resize windows, for example allowing the lowerwindow to cover 75% of the available display screen while the upperwindow covers only 25% of the available display screen.

In the illustrated GUI a portion 219 of the screen is used forpersistent controls that remain on the display screen regardless of theapplications being displayed on the screen. These persistent controlsmay be selected based on the need for frequent access (e.g., temperaturecontrollers 221/222, seat warmers 223/224, climate controller 225 andaudio volume controller 227, etc.) or for safety (e.g., front defrostercontroller 229, rear defroster controller 231, etc.). In the exemplaryscreen, a “settings” button 233 is also shown, which provides the userwith instant access to the various vehicle settings (e.g., lights,sunroof control, etc.). The persistent controls may be configured by theuser, the system/vehicle manufacturer, or by a third party.

In accordance with the invention, when a user selects an applicationwithin taskbar 201, either by touching the selected application if theGUI is a touch-screen or by selecting the application with a mouse ifthe GUI is not a touch-screen (or if the user prefers the use of a mouserather than the touch-screen interface), the user is presented with avisual cue that represents the possible windows in which the applicationmay be launched. For example, FIG. 3 illustrates the same GUI screen asshown in FIG. 2 after the user has first tapped (or otherwise selected)phone application 213. As shown, a miniature representation of the twoavailable launch windows is graphically shown on the screen, whereminiature window 301 represents upper window 215 and miniature window303 represents lower window 217. It will be appreciated that othervisual cues may be used to represent the available launch windows. Notethat the visual cue shows all possible launch windows thus, for example,FIG. 4 illustrates a similar exemplary GUI with three possible launchwindows 401-403 representing zones 405-407, respectively, while FIG. 5illustrates a similar exemplary GUI with four possible launch windows501-504 representing zones 505-508, respectively.

In FIG. 3 application 213 has just been selected and the user has notmoved the phone icon. Therefore at this point in time the user is stilltouching icon 213 or otherwise still selecting icon 213, for example byholding a mouse cursor on icon 213 and still depressing the left mousebutton (i.e., click-and-hold). Next, the user selects the window inwhich to launch the selected application. In order to select the launchwindow the user, while still selecting the icon, moves the icon to thedesired window in the visual representation (i.e., the visual cuedescribed above). For example, assuming a touch-screen display as wellas a two window configuration as described above and illustrated inFIGS. 2 and 3, the user touches the icon of the application to belaunched (e.g., phone icon 213) and then, while still holding the icon,slides the icon to the miniature window in the visual cue thatrepresents the display window in which the application is to belaunched. FIGS. 6 and 7 illustrate icon 213 being slid from its initiallocation to lower miniature window 303, thus causing the correspondingapplication, i.e., phone application, to be launched in the lower window217. Dashed line 601 illustrates the dragging motion of icon 213 duringthis process (note that line 601 is not actually shown on the display inthe preferred embodiment of the invention, but is meant only toillustrate the dragging motion of the icon in these figures).

In a preferred embodiment, the miniature window (e.g., mini-windows 301and 303) of the visual cue in which the icon is currently located ishighlighted, for example by shading the background, thus indicating inwhich window the selected application will launch. This form ofhighlighting, illustrated in FIGS. 8 and 9, aid the user in visualizingthe launch window.

In another technique of indicating the launch window, which can be usedalone or in conjunction with the mini-window highlighting technique, asthe user drags the icon of the application to be launched over theminiature windows of the visual cue (i.e., mini-windows 301 and 303),the application will appear in a semi-transparent state as an overlay onthe corresponding window (i.e., windows 215 and 217). Therefore whenicon 213 is first selected and the user has not moved the icon out ofupper visual cue window 301, the phone application will be visible overthe browser application as illustrated in FIG. 10. If the user, prior tolifting their finger off of the screen (or unclicking the mouse button),moves icon 213 to lower visual cue window 303, then the phoneapplication will be visible over the current lower window application(e.g., the navigation application in this example) as illustrated inFIG. 11.

After the user decides on the desired window for launching the selectedapplication, they merely left their finger from the screen (or releasethe previously selected mouse button). At this point the selectedapplication will completely materialize in the selected window,replacing the application previously displayed in that window. Thus, forexample, if after moving icon 213 to lower visual cue window 303 asshown in FIG. 11, once the user lifts their finger from the touch-screenthe phone application corresponding to selected icon 213 completelymaterializes in window 217 as illustrated in FIG. 12.

In an alternate embodiment, the user selects the window in which anapplication is to be launched by dragging the icon from the taskbar tothe desired launch window and then releasing the icon. Preferably thedragging and release functions are performed by the user via touching,dragging and removing their finger from a touch-screen although thistechnique is equally applicable to non-touch-screens (e.g., using amouse to select, drag and release the application icon). As in the priorembodiment, this technique requires that the GUI display screen bedivided into two or more windows, each of which can be used to display aselected application (see, for example, screen 200 shown in FIG. 2 thatincludes an upper window 215 displaying web browser application 209 anda lower window 217 displaying a map selected via navigation interfaceapplication 205).

FIGS. 13-16 illustrate a user's finger 1301 touching icon 213 (FIG. 13),dragging icon 213 downwards (FIG. 14) to lower window 217 (FIG. 15), andthen releasing the icon FIG. 16. Upon release, the applicationassociated with the selected icon, which in this example is the phoneapplication, materializes in the selected window as shown in FIG. 16. Aspreviously noted, in this embodiment a window is selected by placing theicon associated with the desired application, for example using atouch-and-slide motion on a touch-screen, anywhere within the window inwhich the application is desired.

Preferably in this embodiment as the user drags the selected icon acrossthe GUI display screen, the application associated with the selectedicon partially materializes in whichever window the selected icon iscurrently within. Therefore as the user is dragging icon 213 acrossupper window 215 and then lower window 217, instead of the screens shownin FIGS. 14 and 15 the screens would include a semi-transparent view ofthe phone application overlaying the current application as illustratedin FIGS. 17 and 18.

Preferably in any of the previously described embodiments, when a userselects an icon, the icon changes in some small way, thus indicating tothe user that the icon has been selected. For example, the icon canchange size or color, thereby highlighting to the user that the icon hasbeen selected. This feature is especially useful if the taskbar iscrowded with icons, or if the invention is utilized in a car or othersystem in which the user may be distracted by other events, therebymaking it difficult to accurately select a particular icon. This aspectis illustrated in FIG. 19, which is based on the view provided in FIG.13, in which icon 213, after being selected, is enlarged and shaded.

While one of the goals of the present invention is to simplify thelaunch of an application within a window of a multi-windowed GUIdisplay, it will be appreciated that the user may also wish to displaythe selected application in the entire display screen, i.e., coveringall windows. In any of the previously described embodiments, preferablythe user is able to toggle between a full-screen view and apartial-screen view in which the selected application is displayed inone window of a multi-windowed display screen by simply tapping on theicon corresponding to the application to be re-sized. Thus, for example,if the GUI display currently shows the screen shown in FIG. 2, bytapping on icon 205 the user can enlarge the navigation screen such thatit covers the entire display screen (e.g., both upper window 215 andlower window 217). Tapping the same icon again will re-size thenavigation screen such that it only covers lower window 217.Furthermore, in at least one preferred embodiment if the user wishes tolaunch an application in a full-screen mode, instead of using the visualcue approach described above relative to FIGS. 3-12 or thetouch-and-slide approach described above relative to FIGS. 13-18, theuser simply double taps (or double clicks) the icon associated with thedesired application.

It should be understood that identical element symbols used on multiplefigures refer to the same component, or components of equalfunctionality. Additionally, the accompanying figures are only meant toillustrate, not limit, the scope of the invention and should not beconsidered to be to scale.

Systems and methods have been described in general terms as an aid tounderstanding details of the invention. In some instances, well-knownstructures, materials, and/or operations have not been specificallyshown or described in detail to avoid obscuring aspects of theinvention. In other instances, specific details have been given in orderto provide a thorough understanding of the invention. One skilled in therelevant art will recognize that the invention may be embodied in otherspecific forms, for example to adapt to a particular system or apparatusor situation or material or component, without departing from the spiritor essential characteristics thereof. Therefore the disclosures anddescriptions herein are intended to be illustrative, but not limiting,of the scope of the invention.

What is claimed is:
 1. A method of launching a software application on agraphical user interface (GUI) screen of a display coupled to a systemcontroller that provides access to a plurality of vehicular subsystems,the method comprising the steps of: providing a taskbar on a firstportion of said GUI screen; displaying a plurality of icons within saidtaskbar, wherein each of said plurality of icons represents acorresponding one of a plurality of applications; configuring a secondportion of said GUI screen into a plurality of windows, wherein each ofsaid plurality of windows is pre-sized; receiving a user selection of aselected icon, wherein said selected icon is one of said plurality oficons located within said taskbar, and wherein said selected iconrepresents an application, of the plurality of applications, to belaunched; determining, based on user input, that a user is dragging saidselected icon from an initial location on said taskbar into a selectedwindow of said plurality of windows; displaying a semi-transparentoverlay, corresponding to the application to be launched, on at leastone window of said plurality of windows as said selected icon ispositioned within the at least one window; and launching the applicationin said selected window of said plurality of windows when determiningthat said selected icon is released by the user within said selectedwindow, wherein the application provides at least one of control optionsor monitoring information relating to a vehicular subsystem of theplurality of vehicular subsystems.
 2. The method of claim 1, whereinsaid GUI screen comprises a touch-screen, wherein receiving a userselection of said selected icon includes determining that the user istouching said selected icon on said touch-screen, and whereindetermining that said selected icon is released by the user includesdetermining that the user is no longer touching said selected icon onsaid touch-screen.
 3. The method of claim 1, wherein receiving a userselection of said selected icon includes determining that the user isplacing a cursor over said selected icon with a mouse controller andperforming a click-and-hold operation with a mouse controller button,and wherein determining that said selected icon is released by the userincludes determining that the user unclicks said mouse controllerbutton.
 4. The method of claim 1, wherein launching the applicationfurther comprises completely materializing said semi-transparent overlayin said selected window when said selected icon is released.
 5. Themethod of claim 1, wherein said plurality of applications includes oneor more applications for controlling one or more of the plurality ofvehicular subsystems.
 6. The method of claim 1, wherein said GUI screenis mounted within a central console of a vehicle.
 7. The method of claim1, wherein said plurality of applications include at least one of anentertainment system application, a navigation system application, anenergy tracking application, a browser application, a camera applicationor a phone application.
 8. The method of claim 1, further comprising thestep of providing a plurality of persistent controls on a third portionof said GUI screen.
 9. The method of claim 8, wherein said plurality ofpersistent controls include at least one of: vehicle setting controls;passenger cabin temperature setting controls; vehicle seat warmercontrols; audio volume controls; or defroster controls.
 10. The methodof claim 1, further comprising the step of altering an appearance ofsaid selected icon after receiving said user selection of said selectedicon.
 11. The method of claim 10, wherein altering the appearance ofsaid selected icon includes enlarging said selected icon.
 12. The methodof claim 10, wherein altering the appearance of said selected iconincludes changing a color associated with said selected icon.
 13. Themethod of claim 1, wherein following launching of the application, themethod further comprises: in response to determining a user tap of saidselected icon, toggling the selected window from a first window size toa second window size, wherein the second window size coverssubstantially all of said second portion of said GUI screen.
 14. Themethod of claim 1, the method further comprises: when determining adouble tap of said selected icon by a user, launching the applicationrepresented by said selected icon in a full screen mode.